RATING METHOD AND RATING APPARATUS FOR PRODUCTION PROCESS 



BACKGROUND OF THE INVENTION 

1. FIELD OF THE INVENTION 

This invention relates to a rating method and a rating 
apparatus for a production process that is useful for batch 
processes applied to chemical, pharmaceutical and food 
industries as well as continuous processes and discontinuous 
processes . 

2. DESCRIPTION OF THE RELATED ART 

Recently, production efficiency has been improved 
utilizing information technology (IT). This requires a 
production site to construct a mechanism for efficiently 
producing demanded products at a profit-making cost. To check 
whether production is efficient or not, a technique that 
enables proper rating of the production process is necessary. 

One of production processes is a batch process. In the 
following description, a batch process is used as an example. 
Conventionally, a technique such as KPIs (key performance 
indicators) has been used as a rating method for a batch 
process . 

The procedure for rating a batch process using the KPIs 
technique will be described. 

Individual parameters used for rating a batch process 
include, for example, production cycle time, amount of 
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production, quality of product, production cost and the like. 

In the KPIs technique, a certain parameter is estimated. 
Achievement data of the estimated parameter is compared with 
a mean value and a standard deviation of this parameter. The 
result of the comparison is expressed, for example, by a score 
of 0 to 100%. The mean value and the standard deviation of 
each parameter are a mean value and a standard deviation of 
production cycle time, amount of production and the like based 
on the same revision as a recipe revision that is currently 
being executed in the batch process. The achievement data is 
acquired by the execution of the batch process. 

In this manner, in the KPIs technique, the batch process 
is rated on the basis of the position of achievement data of 
a certain parameter in relation to a mean value and a standard 
deviation of this parameter. 

However, the batch process rating method using the KPIs 
technique has a problem that it enables only one -dimensional 
rating because the result of rating is based on only one 
parameter, and that it is difficult to comprehensively rate 
an entire batch process. 

Fig. 1 shows an exemplary display of the result of rating 
in the conventional technique. 

As shown in Fig. 1, the vertical axis represents 
production cycle time and the horizontal axis represents batch 
ID. In the example of Fig. 1, the production cycle time of 
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each batch is shown in the form of a bar chart. Fig. 1 is a 
graph showing an analysis of variation in the production cycle 
time. In the graph, a mean value and a standard deviation of 
the production cycle time are indicated by horizontal lines. 
In the example of Fig . 1 , the mean value is 0.32 and the standard 
deviation is 0.02. 

Fig. 2 shows another exemplary display of the result of 
rating. 

As shown in Fig. 2, the vertical axis represents the 
number of batches and the horizontal axis represents short, 
medium and long production cycle times. The short, medium and 
long production cycle times are predetermined time periods 
formed by sectioning the production cycle time. Fig. 2 is a 
graph showing an analysis of the frequency of variation in the 
production cycle time. 

The results of rating shown in Figs. 1 and 2 are the 
results of one-dimensional analyses of data of a batch process 
based only on the production cycle time, and the performance 
of the entire batch process cannot be rated comprehensively. 

SUMMARY OF THE INVENTION 
In order to solve the foregoing problem, it is an object 
of this invention to realize a rating method and a rating 
apparatus for a production process that enable comprehensive 
rating of performance of an entire production process and 



3 



multilateral analysis by preparing plural performance rating 
items in advance as rating indexes for the production process, 
then performing addition or subtraction of points or another 
arithmetic operation for rating based on whether a currently 
executed production process satisfies the respective 
performance rating items so as to find a composite value, and 
displaying the final rating value in a graph. 

BRIEF DESCRIPTION OF THE DRAWINGS 
Fig. 1 shows an exemplary display of the result of rating 

in a conventional technique. 

Fig. 2 shows an exemplary display of the result of rating 

in a conventional technique. 

Fig. 3 is a structural view showing an embodiment of this 

invention . 

Fig. 4 shows exemplary performance rating items and 
rating values. 

Fig. 5 shows a procedure for performance rating. 
Fig. 6 shows the procedure for performance rating. 
Fig. 7 shows the procedure for performance rating. 
Fig. 8 shows the procedure for performance rating. 
Fig. 9 shows the procedure for performance rating. 
Fig. 10 shows the procedure for performance rating. 
Fig. 11 shows the procedure for performance rating. 
Fig. 12 shows an exemplary display of the result of 
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performance rating . 

Fig. 13 shows an exemplary display of the result of 
performance rating . 

Fig. 14 shows an exemplary display of the result of 
performance rating . 

Fig. 15 shows an exemplary display of the result of 
performance rating . 

Fig. 16 shows an exemplary display of the result of 
performance rating . 

DESCRIPTION OF THE PREFERRED EMBODIMENTS 

This invention will now be described in detail with 
reference to the drawings. Fig. 3 is a structural view showing 
an embodiment of this invention. 

In Fig. 3, a storage unit 41 stores plural data including 
performance rating items associated with rating values, as 
rating indexes for a production process. 

A gathering unit 42 gathers necessary achievement data 
for rating when a production process is executed. 

An arithmetic unit 43 judges whether the executed 
production process satisfies conditions defined by the 
performance rating items, on the basis of the achievement data. 
Initially, a reference score is provided as a default value. 
In accordance with the result of the judgment by the arithmetic 
unit 43, a point or points are added to or subtracted from the 
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score , or another arithmetic operation for rating is performed . 
Another arithmetic operation for rating may be, for example, 
multiplication, division or the like. When the production 
process satisfies the conditions defined by the performance 
rating items, the reference score is multiplied by a number 
larger than 1. When the conditions are not satisfied, the 
reference score is multiplied by a number smaller than 1. 

This realizes comprehensive rating of the production 
process based on the plural performance rating items. 

For example, in the case of a batch process, when a batch 
or unit recipe ends, the gathering unit 42 gathers achievement 
data of the batch. The arithmetic unit 43 performs performance 
rating calculation of the batch or unit recipe. The 
performance rating is to rate the achievement of an executed 
batch or unit recipe, using a value of 0 to 100%. A batch or 
unit recipe of 0% indicates the least performance, and 100% 
indicates the best performance. 

A display control unit 4 4 prepares data for displaying 
a graph showing the result of the rating by the arithmetic unit 
43. A display unit 45 displays a graph showing the result of 
the rating by the arithmetic unit 4 3 on the basis of the data 
prepared by the display control unit 44. 

Fig. 4 shows exemplary performance rating items and 
rating values . 

Fig. 4 shows exemplary performance rating items of a 
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batch process. The performance rating is carried out by 
comparing rating data such as production cycle time, hold, 
abort and the like with achievement data of a batch, on 
condition of a basic recipe or unit recipe based on the same 
revision. For example, the performance rating is calculated 
on the basis of reference score of 70%. Depending on whether 
or not the gathered achievement data satisfies the rating items 
shown in Fig. 4, a rating value is added to or subtracted from 
the reference score of 70%, or another arithmetic operation 
for rating is performed. Each rating item and rating value 
can be added or adjusted. 

A procedure for performing rating using an apparatus of 
according to an embodiment will now be described. Figs. 5 to 
11 are flowcharts showing the rating procedure. The procedure 
includes many steps and therefore is shown in plural drawings. 
A symbol following the last step in each drawing continues to 
a symbol prior to the first step in the next drawing. For 
example, "A" in Fig. 5 continues to "A" in Fig. 6. The 
flowcharts will be described in the order of steps. 
(Step 101) 

It is judged whether or not the number of batches based 
on the same recipe revision as a recipe revision to be rated 
(current recipe revision) is equal to or larger than "the 
minimum number of batches in rating calculation) . 
(Step 102) 
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If the result of the judgment at step 101 is Yes, an 
arithmetic operation for performance rating is started. If 
the result is No, the arithmetic operation for performance 
rating is not started. In this example, "the minimum number 
of batches in rating calculation" is five. 
(Step 103) 

If the number of batches is equal to or larger than "the 
minimum number of batches in rating calculation" , a performance 
rating value is set at a default reference score of 70. 
(Step 104) 

A mean value of the production cycle time of batches based 
on the same revision as the current recipe revision is 
calculated. 
(Step 105) 

A standard deviation of the production cycle time of 
batches based on the same revision as the current recipe 
revision is calculated. 
(Step 106) 

An upper limit value of the production cycle time of 
batches is calculated. The upper limit value is (mean value 
+ standard deviation) . 
(Step 107) 

A lower limit value of the production cycle time of 
batches is calculated. The lower limit value is (mean value 
- standard deviation) . 
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(Steps 108 to 111) 

Similarly, a mean value, a standard deviation, an upper 
limit value and a lower limit value of the production cycle 
time for each unit recipe in batches are calculated. 
(Step 201) 

It is judged whether or not a batch or unit recipe is 
aborted. 
(Step 202) 

When it is aborted, points due to the abort (25 points) 
are subtracted from the current performance rating score. 
(Step 203) 

It is judged whether or not the production cycle time 
of batches exceeds the upper limit value. 
(Step 204) 

If it exceeds the upper limit value, points due to the 
excess over the upper limit value (20 points) are subtracted 
from the current performance rating score. 
(Step 205) 

It is judged whether or not the production cycle time 
of batches is between the upper limit value and the mean value. 
(Step 206) 

If the production cycle time is between the upper limit 
value and the mean value, points due to the production cycle 
time being between the upper limit value and the mean value 
(10 points) are added to the current performance rating score. 
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(Step 301) 

It is judged whether or not the production cycle time 
of batches is between the lower limit value and the mean value. 
(Step 302) 

If the production cycle time is between the lower limit 
value and the mean value, points due to the production cycle 
time being between the lower limit value and the mean value 
(15 points) are added to the current performance rating score. 
(Step 303) 

It is judged whether or not the production cycle time 
of batches is less than the lower limit value. 
(Step 304) 

If the production cycle time is less than the lower limit 
value, points due to the production cycle time being less than 
the lower limit value (20 points) are subtracted from the 
current performance rating score. 
(Step 305) 

It is judged whether or not the production cycle time 
for any unit recipe exceeds the upper limit value. 
(Step 306) 

If the production cycle time exceeds the upper limit 
value, points due to the excess over the upper limit value (10 
points) are subtracted from the current performance rating 
score . 
(Step 401) 
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It is judged whether or not the batch or any unit recipe 
was held. 
(Step 402) 

If it was held, points due to the hold (10 points) are 
subtracted from the current performance rating score. 
(Step 403) 

It is judged whether or not the time when the batch or 
any unit recipe is in hold exceeds a "time in hold limit (%)". 
(Step 404) 

If the time when the batch or any unit recipe is in hold 
exceeds the "time in hold limit (%)", points due to the excess 
over the time in hold limit (15 points) are subtracted from 
the current performance rating score. 
(Step 405) 

It is judged whether or not the number of alarms generated 
in the batch (only alarms, no event messages included) exceeds 
the number of alarms limit. 
(Step 406) 

If the number of generated alarms exceeds the number of 
alarms limit, points due to the excess over the number of alarms 
limit (15 points) are subtracted from the current performance 
rating score. 
(Step 501) 

The performance rating score for a unit recipe is set 
at a default reference score. 
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(Steps 502 to 706) 

For a unit recipe, performance rating similar to that 
for the batch is carried out. 

The batch and unit recipe are defined by the 
International Standard related to batch control ANSI/ISA 
S88.01. 

Meanwhile, the following cases are regarded as 
exceptional items and no performance rating is carried out in 
these cases : 

(a) in case the batch start time is corrupt, not accurate 
or missing; 

(b) in case the batch end time is corrupt, not accurate 
or missing; and 

(c) in case the value of date or time is corrupt, not 
accurate or missing. 

The following rating items and rating values can be added 
to the above-described rating items: 

(a) sub-processes other than recipe, unit recipe, unit 
operation and phase; 

(b) unproductive state other than hold; 

(c) various events other than alarm (for example, the 
number of manual operations by an operator, the number of 
messages to an operator, occurrence of important states other 
than abort , etc . ) ; 

(d) various information related to batch production cost 
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(for example, production cost (based on actually used 
facilities), labor cost, material cost, management cost, 
etc . ) ; 

(e) other key parameters; 

(f) quality data from a laboratory; 

(g) the quantity of a material that is actually added 
or consumed; 

(h) actual amount of production; 

(i) difference and achievement of recipe items 
(j) data related to facilities; 

(k) personal data of an operator who took part in 
production ; 

(1) data of lot definition and quality of materials; and 

(m) data of maintenance related to facilities. 

A method for inputting these data is not particularly 
limited. For example, methods such as text input, graphical 
input, and input from an electronic file (text editor, word 
processor, XML file, etc.) may be used. 

Figs. 12 and 13 show exemplary displays of the result 
of performance rating. 

In Fig. 12, the horizontal axis represents batch ID and 
the vertical axis represents performance rating value of 0 to 
140%. Fig. 12 is a chart showing an analysis of variation in 
the performance rating for each batch. 

In Fig. 13, the vertical axis represents the number of 
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batches and the horizontal axis represents performance rating 
value sectioned into ranges of 50 to 60%, 60 to 70%, 70 to 80%, 
80 to 90% # and 90 to 100% . Fig . 13 is a chart showing an analysis 
of the frequency of variation in the batch performance rating. 

Figs. 14 and 15 are charts showing similar analyses for 
a unit recipe. 

Fig. 16 shows another exemplary display of the result 
of performance rating. 

Fig. 16 shows the results of performance rating based 
on different revisions with respect to the same basic recipe 
in the form of radar chart. In Fig. 16, rating values based 
on revisions 1 to 6 are shown. Also mean values are shown for 
comparison . 

In the above-described exemplary displays, vertical bar 
graphs and a radar chart are used, but the form of the display 
is not limited to these. For example, a circle graph, a line 
graph, a pie chart and the like may be used. 

With the charts provided in this invention, it is 
possible to rate data from various viewpoints and 
comprehensively analyze the data, instead of the conventional 
one-dimensional data analysis. 

In the embodiment, the performance rating of a batch 
process is described. However, this invention can also be 
applied to continuous processes and discontinuous processes 
other than a batch process. 
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For example, this invention can be applied to the 
following continuous processes. 

(a) In a continuous distillation process, performance 
rating is carried out and data is analyzed every time the kind 
of crude oil is switched. 

(b) In an ethylene preparation process at a petrochemical 
plant, performance rating is carried out and data is analyzed 
in accordance with the grade of naphtha as a raw material. 

(c) In a steam cracking furnace using a continuous 
process at a paper pulse production plant, performance rating 
is carried out and data is analyzed depending on a wooden 
material (needleleaf tree, broadleaf tree or others) to be used 
as a raw material. 

In these cases, continuous data is sectioned at switching 
timing or at the time of feeding the material, and performance 
rating depends on the material and operation conditions. 

In the case of a discontinuous process, which is easier 
than a continuous process, most data are managed by each lot 
and performance rating is carried out in accordance with 
materials and operation conditions used in each lot . 

When batch ID or unit recipe ID is selected on the displays 
of Figs. 12 to 14, graphs showing rating achievement data of 
production cycle time, amount of production, time in hold and 
the like for the selected batch ID or unit recipe ID may be 
called up onto the screen. This is realized by the following 
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construction . 

A display unit displays, for example, bar graphs for the 
results of rating as shown in Figs. 12 to 14 on the screen. 

A graph preparation unit prepares a rating achievement 
data graph for each batch ID or unit recipe ID from rating 
achievement data with respect to rating parameters such as 
production cycle time, amount of production and time in hold. 
The rating achievement data graph is stored in a memory. The 
rating achievement data is data calculated by comparing 
achievement data acquired by executing a batch process with 
a mean value and a standard deviation. For example, the rating 
achievement data is calculated by the KPIs technique described 
in the conventional technique. 

A selector unit for selecting one of bar graphs displayed 
on the screen is provided. As a bar graph is selected by this 
selector unit, a call-up unit calls up a rating achievement 
data graph including the batch ID or unit recipe ID of the 
selected bar graph, onto the screen. In this case, a bar graph 
is displayed which shows, with bars, the rating achievement 
data of production cycle time, amount of production, time in 
hold and the like for each batch ID or unit recipe ID. This 
makes it easier to analyze a cause when a certain batch ID has 
a low rating value. 

This invention provides the following effects. 

(1) Plural performance rating items as rating indexes 
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for a production process are prepared in advance, and in 
accordance with whether or not the currently executed 
production process satisfies each of the performance rating 
items, a point or points are added or subtracted, or another 
arithmetic operation for rating is performed, thus calculating 
a final rating value. That is, the final rating is based on 
a combination of the results of rating of the plural performance 
rating items. This enables comprehensive rating and 
multilateral analysis of performance of the entire production 
process . 

(2) A production process may be a batch process, a 
continuous process, or a discontinuous process. Therefore, 
the performance of the entire batch process , continuous process 
or discontinuous process can be rated comprehensively and 
objectively. 

( 3 ) A total rating score is decided for each batch process 
or for each unit recipe in the batch process. Therefore, 
performance rating can be made for each batch process or for 
each unit recipe. 

. (4) When the batch production cycle time is between the 
upper limit value and the lower limit value, the arithmetic 
unit adds a rating value to the reference score. When the batch 
production cycle time is more than the upper limit value or 
less than the lower limit value, the arithmetic unit subtracts 
a rating value from the reference score. This enables proper 
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rating of the batch production cycle time. 

(5) Since rating is carried out when the number of times 
a batch based on the same recipe revision is executed is a 
predetermined number or more, highly reliable performance 
rating can be carried out without being affected by temporal 
changes . 

(6) Since the result of performance rating is displayed 
in a graph in which one coordinate axis represents rating score 
and the other coordinate axis represents batch ID or unit recipe 
ID # variation in the performance rating for each batch can be 
easily recognized. 

(7) Since the result of performance rating is displayed 
in a graph in which one coordinate axis represents the number 
of batches or the number of unit recipes and the other 
coordinate axis represents sections of the total rating score, 
the frequency of variation in the performance rating for the 
batch can be easily recognized. 

(8) Since the display unit displays the result of rating 
in a bar graph, a line graph, a circle graph, a radar chart 
or a graph plotting the total rating score, the result of rating 
can be displayed in an easily recognizable form. 

(9) As a bar graph showing the result of rating displayed 
on the screen is selected, a rating achievement data graph 
including batch ID or unit recipe ID based on the selected bar 
graph is called up onto the screen. The rating achievement 
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data graph is a graph showing the rating achievement with 
respect to rating parameters for each data batch ID or unit 
recipe ID. This enables easy and objective analysis of a cause 
when a certain batch ID or unit recipe ID has a low rating value. 
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